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I (54) TlUe: METHOD FOR READING A SYMBOL HAVING ENCODED INFORMATION 




(57) Abstract: Methods and apparatuses are provided for imaging 
and decoding symbols such as two-dimensional relief formed sym- 
bols and in particular, symbols wherein one or mors edges of any 
number of data cells within the symbols are at least partially discem- 
able. In one aspect of the present invention a symbol image based on 
a relief pattern, which represents encoded information and includes at 
least one discemable edge can be determined. Generally, determin- 
ing an edge of the relief pattern and validating the determined edge 
by performing an edge analysis of the determined edge can determine 
the symbol image. A data cell of the symbol image, which at least 
partially represents information encoded in the rehef pattern, can be 
determined so that the symlx)! image can be decoded to provide the 
information encoded within the relief pattern. 
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METHOD FOR READING A SYMBOL HAVING 
ENCODED INFORMATION 

5 Field of the Invention 

The present invention relates to methods and apparatuses for reading and 
decoding symbols having encoded information. In particiilar, the present invention 
relates to me&ods and apparatuses for reading and decoding signals produced from 
two-dimensional relief formed symbols. 

10 Background of the Invention 

Optical imaging systems are commonly used to decipher data symbols 
printed on objects in order to identify the objects or to obtain information relating to 
the object. A bar code symbol is a common one-dimensional form of symbology, 
and typically comprises a pattern of vertical bars of various widths separated by 

15 spaces of various widths. Because the bar and space elements have different light 
reflecting characteristics, a reader can conv^ a symbol into an electrical signal by . 
analyzing the light reflected from the symbol. The electrical signal can then be 
analyzed and decoded to provide an alphanumeric representation of the symbol, 
which can contain certain information about the object Bar code symbols of this 

20 type are now in common usage in various applications, such as inventory control, 
point of sale identification, or logistical tracking systems. 

Because conventional one-dimensional symbology requires a relatively large 
amount of space to convey a correspondingly small amount of data, so-called two- 
dimensional bar code symbologies have been developed. A two-dimensional 

25 symbology may comprise a matrix that occupies a uniform amount of space having a 
generally rectangular or square shape. Instead of bars and spaces, round or square 
marks disposed at particular rows and columns of the matrix correspond to the 
information being conveyed. As a result, a two-dimensional matrix symbology can 
include significantly more data within a given volume of space than a conventional 

30 one-dimensional bar code. 

Many bar code symbols are printed on labels, which are affixed to objects, 
boxes, etc. Alternatively, bar codes can be set in relief or formed within the surface 
of an object. This can be done by stamping, engraving, etching, milling, molding, or 
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by other known methods. The symbols can be either raised firom the surfece or 
depressed within the surface. Such relief formed symbols can be more durable, less 
expensive, and provide other benefits of typical bar code labels. However, such 
relief formed symbols can be difficult to read using currently available non-contact 
5 scanning techniques, because the contrast between raised and recessed portions of 
the symbol is generally low. For example, if a laser scanner scans a relief formed 
symbol, both the high and low regions of tiie symbol reflect the scanning beam 
substantially equally thereby making differentiation between the high and low 
regions very difficult. 

1 0 One particular application of a two-dimensional symbology utilizes a two- 

dimensional symbol in the manu&cture of microelectronics devices such as certain 
flat panel displays. Typically, a symbol is formed directly on a display substrate, 
which is usually glass, by printing with appropriate ink or other suitable technique. 
Alternatively, the symbol could be formed directiy onto the substrate by laser 

15 etching or other suitable precision relief forming process. Because a two- 
dimensional symbology can compress a large amount of data within a relatively 
small dimensional space, the symbol can store a unique identifier code for the 
substrate, including such information as serial number, lot number, batch number, 
model number, and/or customer code. As such, the symbols can be used to automate 

20 the manu&cturing or testing processes, and may also eaable manufacturers to 
protect against component theft or forgery. 

Generally, such symbols formed on typical substrates may be readable with 
conventionally known equipment. However, an early processing step in the 
manufacfaare of certain flat panel displays, such as liquid crystal displays, necessarily 

25 covers the entire substrate, including the symbol, with a thin-fihn coating of a higihly 
reflective metal such as chromium. Because sudi metal coatings are usually 
conformal in nature and very thin, the relief aspects of the symbol formed on the 
substrate are usually preserved in the thin-film coating thereby forming a buried 
relief symbol. A significant drawback of such buried relief symbols is tiiat they 

30 generally have little or no light reflecting contrast and, as a result, can be v&cy 

difficult to image. Because the symbol characters are buried beneath a metal thin- 
film, any color difference that existed between the characters and the substrate can 
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no longer be utilized for imaging the symbol. To compound this problem, the metal 
thin-film usually has a shiny surface finish that tends to fiirther obscure the symbol 

characters. 

Summary of the Invention 
5 The present invention overcomes the disadvantages and shortcomings of the 

prior art by providing methods and apparatuses for imaging and decoding certain 
symbols such as two-dimensional reUef formed symbols. In particular the present 
inv^tion advantageously provides apparatuses and methods to read and decode 
sjmibols wherein one or more edges of any number of data cells within the symbols 

10 are at least partially discemable. Also, methods and apparatuses in accordance with 
the present invention can advantageously be used to perform an edge analysis for 
determining the validity of such edges for decoding the symbols. 

In one aspect of die present invention a symbol image based on a relief 
pattern, which represents encoded information and includes at least one discemable 

1 5 edge can be determined. Generally, determining ah edge of the relief pattern and 
validating the determined edge by performing an edge analysis of the determined 
edge can detemime the symbol image. A data cell of the symbol image, which at 
least partially rqnresents information encoded in the relief pattern, can be determined 
so that the symbol unage can be decoded to provide the information encoded within 

20 the relief pattern. 

In another aspect of the present uivention an apparatus for reading a relief 
pattern having at least one discemable edge and representing encoded information is 
provided. Generally, the apparatus includes means for creating an edge image from 
a reflected light pattern aiid means for verifying the validity of an edge of the edge 

25 image. The edge image is preferably created fix>m light reflected from the relief 

pattern. The validity of an edge of the edge image is preferably determined so that a 
data cell of a symbol image based on the relief patt^ can be decoded to provide the 
information encoded within the relief pattern. 

These and other features and advantages of tiie present invention will be 

30 apparent in the following detailed description of the preferred embodimaits when 
read in conjunction with the accompanying drawings, in which like reference 
numerals are used to identify the same or sknilar parts in the several views. 
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Brief Description of the Drawings 

The accompanjnng drawings, which are incorporated in and constitute a part 
of this application, illustrate several aspects of the invention and together with 
description of the embodiments serve to explain the principles of the invention. A 
5 brief description of the drawings is as follows: 

Figure 1 is an exemplary two-dimoisional symbol shown on a substrate and 
showing in particular an intemal data field of the symbol comprising a plurality of 
data cells; 

Figure 2 is a cross-sectional view of the symbol of Fig. 1 taken along line 2-2 
1 0 showing in particular portions of the symbol that are raised above a surface of the 
substrate thereby foiming a relief symbol; 

Figure 3 is a cross-sectional view of the symbol of Fig. 1 also taken along 
line 2-2 out further including a coating covering the symbol; 

Figure 4 is a schematic block diagram of an exemplary imaging system 
15 including a ligjit source and a reader in accordance with an aspect of the present 
invention for imaging and decoding a symbol such as the symbols shown in Figs. 1, 
2 and 3; 

Figure 5 is an edge image of the symbol shown in Fig. 1 as imaged according 
to an aspect of the present invention such as by the imaging system shown in Fig. 4 
20 and showing in particular edges of the raised portions of the symbol; 

Figure 6 is a schonatic block diagram of a reader usable in accordance with 
the present invention having a imaging device and an output in accordance with an 
aspect of the present invention for processing a symbol such as the edge image 
shown in Fig. 5; 

25 Figure 7 is a flowchart of a edge analysis algorithm m accordance witii the 

present invention; 

Figure 8 is a view of the edge image of Fig. 5 shown in a Cartesian 
coordinate system; 

Figure 9 is a view of the edge image of Fig. 8 further showing indications of 
30 the centers of the data cells of the symbol; 
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Figure 10 is a view of the edge image of Fig. 9 further showing in particular 
numerical values assigned to certain comers of the data cells in accordance with an 
aspect of the present inventioi^ 

Figure 1 1 is a view of the edge image of Fig. 9 but further showing 
5 exemplary invalid edges that can be determined in accordance with an aspect of the 
present invention; 

Figure 12 is a view of the edge image of Fig. 9 showing in addition binary 
values assigned to &e data cells of &e edge image also in accordance with another 
aspect of the present invention; 
1 0 Figure 1 3 is a flowchart of an edge analysis algorithm of the present 

invention that may be used for the steps 322 and/or 324 of the flowchart of Fig. 7; 
and 

Figure 14 is a view of the edge image of Fig. 1 1 showing in addition binary 
values assigned to the data cells of the edge image also in accordance with another 

1 5 aspect of the present invention. 
Detailed Description 

The present invention is directed to methods and apparatuses for effectively 
reading and decoding certain images or symbols such as relief symbols. In 
particular, the present invention has been developed to analyze images of symbols 

20 containing one or more edges of any number of data cells which may comprise 
geometric shapes contained within the symbols and which data cells generally 
provide coded information that can be read in accordance with the present invention. 
Such methods and apparatuses in accordance with the present invention can 
advantageously also be used to perform an edge analysis for determining tiie validity 

25 of such edges for decoding the symbols. 

The principles of the present invention may be applied to any symbol firom 
any linear or stacked area, or other symbology, and preferably those symbols formed 
as area relief patterns, as discussed below. An area symbology, as used herein, 
refers to any symbology, such as those commercially known under the tradenames 

30 Vericode™ or Data Mafaix™ or Code One™ or the like, fliat employs a matrix of 
- data cells, rather than one or more rows of bars and spaces. A stacked symbology, 
as used herein, refers to any symbology, such as PDF 417, that generally employs 



wo 2004/006438 



-6- 



PCT/US2003/009971 



several adjacent rows of symbols, each row having several characters defined by 
groups of multiple-width bars and spaces. 

Area symbologies are well known, such as are described in U.S. Patent No. 
5,612,524, and U.S. Patent No. 4,924,078. A typical symbol 10 fix)m such an area 
5 symbolo^ is illustrated in Fig. 1. Generally, the symbol 10 includes an internal 
data field 12 with internal data cells 14 arranged in a matrix, which data field 12 and 
data cells 14 are preferably rectangular as illustrated, although any other shapes are 
contemplated. As shown, the internal data field 12 has certain data cells 14 that are 
"on" and certain data cells 14 that are "off." As shown, the "on" cells are black (the 

10 cells designated by reference numerals 16, 18, 20, and 22) while the "off" cells are 
white (the remaining cells of the internal data field 12). Such on and off 
designations are used in decoding a symbol such as the symbol 10. It is understood 
that any binary designation may be used for differentiating between data cells 14 
including on and off, 0 and 1, as well as black and white. 

15 As illixstrated, the internal data field 12 is preferably surrounded by an 

orientation and/or timing data cell border 24, which is typically used for timing and 
symbol orimtation. The border is typically formed from "on" data cells as 
illustrated. An external data field 26 sxirrovmding the border 24 may be provided, 
which may include external data cells (not shown) for providing additional 

20 information on orientation, timing or symbol identification. Preferably, surrounding 
the border 24 or the external data field 26, if provided, is a quite zone equivalent to 
one or more concentric rectilinear rings of "off' data cells surrounding the outermost 
pattern of "on" cells. The required number of concentric rectilinear rings of the 
quite zone may be determined by the environmental &ctors of symbol usage. 

25 Alternatively, the external data field 26 can act as a quiet zone or can be surrounded 
by a fijrther quiet zone. 

The symbol 10 may be formed directly on a substrate 28 such as by printing 
or controlled deposition of inks or other coatings, or may be provided onto a sticker 
or label by printing or any other suitable technique and then adhered or otherwise 

30 attached to a substrate. Alternatively, the symbol 10 can also be etched, engraved, 
or otherwise formed as a relief pattern on a suitable substrate or object. As an 
example, the substrate 28 may be a glass substrate and the symbol 10 may be printed 
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on the substrate 28 with appropriate ink or the like so as to have any appropriate 
thickness that is capable of forming a relief symbol. To be capable of forming a 
relief symbol, the thickness of the symbol must merely be discernible as part of an 
edge analysis conducted as described below. It is understood that the substrate 28 
5 may be any substrate or object capable of having a symbol formed thereon and that 
the S5mbol may be formed as a high contrast symbol, low contrast symbol, relief 
symbol, non-relief symbol, or as any other known or developed format and may be 
formed by any technique. 

In Fig. 2, a cross-sectional view of the symbol 10 of Fig. 1 is shown. 

10 Generally, the border 24 and the data cells 14, such as the data cell 18, are provided 
as raised regions with respect to a surface 30 of tiie substrate 28 when the symbol 10 
is formed as a relief symbol. Alternatively, the border 24 and the data cells 14 may 
be formed as recessed regions with respect to the surface 30 of the substrate 28. 
Such raised or recessed regions include one or more discernible edges thereof. As 

15 shown, the portion of the border 24 on the left side has edges 32 and 34, the data cell 
1 8 has edges 36 and 38, and the portion of the border 24 on the ri^t side has edges 
40 and 42. It is noted that the illustrated symbol 10 includes additional edges not 
visible in the cross-section of Fig. 2. For example, referring back to Fig. 1, the data 
cell 18 includes edges 44 and 46. 

20 For certain applications, the aitire symbol 1 0 or certain portions of the 

symbol, such as the data cells 14 or the border 24 may be formed so that there is 
little or no contrast in light reflectivity between the symbol 1 0 and the siirface 30 of 
the substrate 28. For example, a symbol such as tiie symbol 10 may be printed or 
otherwise formed on a substrate wherein the color of flie symbol and the color of the 

25 substrate are substantially the same. In the case of a relief symbol etched or formed 
directly into a substrate, little or no contrast may be present because the symbol is 
formed directly into the bulk of flie substrate and no color difference is present. 

Alternatively, a symbol such as the symbol 10 may be covered (at least 
partially) with a coating, either intentionally or unintentionally, so that any contrast 

30 that may have been originally present between the symbol and the substrate is no 
longer substantially present. Such coatings may include inks and/or paints fiom 
writing or other marking devices, or other coatings fiom a deposition process. 
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Coatings may also be formed as part of a manufacturing process. One 
example can be found in microelectronics device manufacturing technology such as 
flat panel display manufacturing technology. Ref^ring to Fig. 3, a symbol such as 
the symbol 10 may be formed on the sur&ce 30 of the substrate 28, which symbol 

5 10 may contain a imique identifio: code for the substrate 28, including such 
information as serial number, lot number, batch number, etc. Typically, the 
substrate 10 for a flat panel display is a glass or ceramic substrate and the symbol 10 
may be formed thereon by an appropriate technique such as by using 
photolithography or the like. In the manufacture of certain microelectronics devices, 

10 such as liquid crystal displays, part of the process includes covering a substantial 
portion of the substrate with a coating 48 such as a thin metal film, for example 
chromium. Because such coatings are usually conformal in nature and very thin, the 
relief aspects of the symbol formed on the substrate are substantially preserved in 
the thin-film coating. A significant drawback of such relief symbols is that they 

1 5 generally have little or no contrast in light reflectivity and, as a result, can be very 
difficult to image and decode xising conventional light reflectivity reading. Because 
the symbol characters become buried beneath a metal thin-film in such applications, 
the color difference that existed between the characters and the substrate no longer 
can be utilized in viewing or reading the symbol. To compound this problem, a 

20 metal thin-film such as chromium provides a shiny or highly reflective surface finish 
that tends to further obscure the geometric shapes that make up the symbol 
characters such as the data cells 14. As such, the information contained in the 
symbol is contained in the spatial domain and cannot be read with conventionally 
known readers. Accordingly, the inventive aspects of the present invention provide 

25 methods and apparatuses for imaging and decoding such symbols. 

Referring next to Fig. 4, an imaging system 100 for reading symbols such as 
the relief symbols described above is illustrated. Generally, the imaging system 100 
comprises one or more light sources 102 and a reader 104. As shown, a light beam 
101 firom the light source 102 impinges upon a surface 106 of a substrate 108 where 

30 it is reflected as a light beam 1 03 to be received by the reader 1 04. Prefaably, the 
light source 102 is capable of edge illimiination of relief patterns. In particular, the 
light source 102 is preferably capable of at least partially illuminating at least some 
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edges within a sjmoibol fonned on the surface 106 of the substrate 108. Suitable 
lights for illuminating edges include those used in conventionally known dark field 
optical microscopy devices and illumination sources. In any case, the light source 
102 can comprise any known or developed device for generating light such as an 

5 incandescent light source, a light emitting or laser diode, etc. 

The light source 102 may be oriented in any manner as long as at least one or 
more edges can be discerned. Where the symbol edge(s) are substantially 
popendicular to the substrate, for example, the light source 102 should be at least 
somewhat obliquely oriented to show the edge(s). As shown, the light source 102 

1 0 may be offset from the reader 1 04, which is preferably positioned above a portion to 
the substrate 108 to be analyzed by the reader 104. As one example, a ring light 
formed from light emitting diodes or the like may be used. Such a ring light can 
obliquely provide light from all sides of a substrate thereby illuminating the edges. 
Any light sensor can be utilized within the reader 104 based upon the type of light 

1 5 reflected, which one or more sensors may be arranged to receive reflected light and 
to provide signals representing die detected edge pattern. Moreover, the light source 
102 and/or the reader 104 maybe moved relative to the substrate or to each other to 
scan for edges. 

In Fig. 5, the symbol 10 of Fig. 3 that may be coated with the coating 48 is 
20 illustrated as it would appear when illuminated with one or more appropriate light 
source such as the edge illumination capable light source 102 previously described 
thereby forming an edge image 200 of the symbol 10. As can be seen, edges of 
raised portions of the relief symbol are read. 

In Fig. 6, an exemplary embodiment of a reader 104 in accordance witix the 
25 present invention is illustrated. The reader 104 can comprises memory 110, a 

central processing unit or CPU 1 1 2, an imaging device 114, and an output 116. For 
certain applications, the imaging system 100 may also include a gain control (not 
shown) for controlling the output level of signals produced by the imaging device 
1 14 and a light level detector (not shown). 
30 The entire imaging system 1 00 may be contained within a single unit. 

Alternatively, the elements may be distributed so that a simple, lightweight unit is 
used to create image data and to transmit the data to a central unit for further 



i 



wo 2004/006438 



PCT/US2003/009971 



-10- 

processing. The image data may then be transmitted to an attached computer, stored 
locally for later transfer or forwarded to an ^plication program resident within the 
inMging system itself 

The CPU 1 12 preferably controls certain operations of the imaging system 

5 100 in accordance with instruction sets, e.g., software or firmware, stored in the 
memory 110. It is contemplated that the CPU 112 may control operations, such as 
decoding image data stored in the memory 110, transferring the image data to other 
systems, activation of the light source 102, and &e storing of data m fhe memory 
110. It is also noted that multiple CPU's may be used for performing individual 

1 0 tasks such as decoding. 

Any conventional CPU 1 12 or microprocessor may be used with the present 
invention. The memory 110 preferably comprises a semiconductor-based read only 
memory (ROM) device because such devices are non-volatile and permit the stored 
instructions to remain in storage within tiie devices even after electrical power is 

15 removed. Other memory devices are also contemplated. 

It is contemplated that the ftinctions performed by the stored instruction set 
may also be accomplished by traditional hard whed drcuits; however software or 
firmware systems are preferred due to their relative simplicity, adaptability to 
change, and low cost. It is also contemplated tiiat any ROM devices such as the 

20 memory 110 may further be erasable or programmable, so that modifications or 
revisions to the software can be implemented as desired. Moreover, other 
pomanent storage media can be utilized as memory 110, such as magnetic or optical 
disks. 

In one aspect of ftie present invention, the imaging device 1 14 preferably 
25 converts received light into a plurality of electrical signals that correspond to the 

intensity of the received light. The plurality of electrical signals may then be further 
amplified and converted into digitized data, which represent an image of the 
substrate 108 including a symbol to be read. The imagmg device 1 14 may comprise 
a charge coupled device (CCD), for example. Moreover, one such imaging device 
30 may use complimentary-metal-oxide-semiconductor (CMOS) technology. 

Typically, a CCD comprises a one-dimensional or two-dimensional array of adjacent 
photodiodes with each photodiode defining a distinct picture element (or pixel) of 
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the array. It is noted that the array of the CCD imaging element is not limited to any 
particular pattern. For example, the array can be arranged in tiie usual order of 
linear rows and columns; the array can be arranged in a diamond pattern in which 
the rows are linear and the columns are of&et in a regular fashion; or the array can 
5 be arranged in any other pattern in which die photodiodes are ordered relative to 
each other. 

Each photodiode of the CCD array generates a voltage and/or current that 
represents the intensity of tiie light reflected onto the particular photodiode. The 
CCD array is scanned electronically by activating the individual photodiodes in a 

1 0 sequential manner in order to produce an output signal containing the voltage and/or 
current levels from each photodiode. The detected voltage and/or current levels are 
then preferably amplified and converted to binary data values. After the imaging 
device 1 14 converts tiie received light mto binary data values representing an image 
of the symbol, the binary data values may be transmitted to the memory 110, which 

1 5 may also include conventional semiconductor-based random access memory 
(RAM). 

For certain applications the imaging device 114 may also include a light 
level detector (not shown) for detecting the intensity level of the light reflected onto 
the imaging device 1 14. The light level detector may provide a digitized output to 

20 the CPU 1 12 indicating the instantaneoxis intensity level of the light reflected onto 
the imaging device 1 14. Such light level detectors are well known in the art, and 
any suitable detector can be used with the present invention. 

A preferred method of effectively reading such a relief symbol in accordance 
with the present invention generally comprises performing an edge analysis of an 

25 image such as that of the edge image 200 shown in Fig. 5. Preferably, a multi-step 
edge analysis is performed in order to efficiently and reliably read such a relief 
symbol but also to eliminate invalid edges and to assign binary values to the data 
cells of the symbol for use in decoding the symbol. Invalid edges may be present in 
such an image for a variety of reasons. For example, such images, especially those 

30 for relief symbols covered with some coating as described above can be difficult to 
image and may contain artifacts and/or features which appear to be edges of the 
xinderlying symbol. Also, dust and dirt, as well as smudges or other extraneous 
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marks may appear to be edges. Accordingly, the principles and concq)ts of the 
present invention are useful for analyzing such images in determining the validity or 
invalidity of potential edges and will be discussed with referraice to the exemplary 
edge image 200 shown in Fig. S and tibe process flowchart shown in Fig. 7. 
5 Referring to Fig. 7, a preferred process 300 for decoding a symbol m 

accordance with the present invention is shown. An initial step 302 obtains an 
image to be analyzed such as the edge unage 200 shown in Fig. 5, An image may be 
obtained by any known or developed technique such as by using a conventional 
camera or by using the imaging system 100 discussed above. It is noted that an 
1 0 image may contam a single symbol to be decoded or may contain multiple symbols 
to be either simultaneously or sequentially decoded in accordance with the present 
invention. 

A next step 304 finds objects within an image obtained in step 302. For 
example, regions or areas of contrast may be identified as objects to be analyzed. 

15 Generally, an image can contain valid S5anbols as well as objects that appear to be 
symbols such as smudges or ractraneous marks, writing, and other symbols, which 
do not contain coded information. Preferably, the step 304 identifies all objects 
within an image of interest that may be symbols or portions of symbols. Such may 
be accomplished by using known or developed image processing or graphical 

20 analysis techniques to determine and evaluate areas of contrast, color, shape, etc. 
Such image analysis techniques are well known and commercially available. It is 
contemplated that multiple objects within a symbol may be prioritized or ranked 
such that they are analyzed in a particular order. For example, objects may be 
ranked based on size or sibaps such fhat an object that is likely to be a valid symbol 

25 is analyzed before an object that is not. 

A step 306 begins the analysis of a first object identified in step 304. It is 
contemplated, however, that all of the objects identified by step 304 may be 
simultaneously analyzed such as by using multiple image analysis systems or 
another similar approach. A step 308 finds the edges or outside boundaries of the 

30 object being analyzed such as the edge image 200 shown in Fig. 5. Any technique 
for determining the edges of the object may be used. One preferred technique is to 
use a Hou^ transform, which determines straight lines. 
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For example, referring to Fig. 8, the edge image 200 is shown in a Cartesian 
coordinate system having axes 202 and 204. The coordinate system may be used in 
order to determine the relative positions of certain aspects of the edge unage 200 and 
may be used, in particular, by any image analysis software that is vised. It is noted 
5 however, that any coordinate system may be used in addition to or different from a 
Cartesian coordinate system. Preferably, step 308 identifies edges 206, 208, 210, 
and 212 of the edge unage 200. The edges 206, 208, 210, and 212 define the outer 
boundaries of the symbol of the edge image 200. A next step 310 determines the 
comers of the edge image 200 by considering the intersection of the edges identified 

10 in step 308. Thus, as can be seen in Fig. 8, the intersection of the edges 206, 208, 
210, and 212 occur at points (1, 1), (1, 9), (9, 9), and (9, 1) thereby defining the 
comers of the edge image 200. 

A step 312 determines the positions of the centers of the data cells of the 
edge image 200. In one aspect of the present invention this may be accomplished 

15 when the dimensions of the edge image 200 are known. For example, as illustrated, 
the edge image 200 can be known to comprise an 8 x 8 matrix of data cells having 
the edges 206, 208, 210, and 212. Accordingly, the matrix comprises 64 data cells 
(each data cell is 1 x 1). Each of the 64 data cells has a center point within the 
coordinate system, which can easily be detmnined. That is, the center of such a cell 

20 is halfway between each axis of the cell. Referring to Fig. 9, a data cell 214 is 
shown and has center point (1 .5, 1 .5). Another data cell 21 6 is illustrated and has 
center at point (5.5, 4.5). Accordingly, the center point of each of the 64 data cells 
of edge image 200 are illustrated as crosses in Fig. 9. It is contemplated, that the 
centers of die cells may be determined in any way and that the dimensions of the 

25 edge image or symbol of interest to be decoded need not be known. That is, the 
process 300, or a portion thereof, may be iteratively repeated by trying different 
matrix configurations until a solution is found. Generally, in one aspect of the 
present invention, the process may be repeated until the symbol decodes. It is 
fijrther contemplated that this technique may be applied to any edge image or 

30 symbol and is not limited to a square matrix. 

A similar step 314 determines the relative positions of the comers of the data 
cells within the coordinate system. Agam, as above with respect to determining the 



wo 2004/006438 



-14- 



PCT/US2003/009971 



centers of the data cells, the comers of the data cells can be easily determined within 
the coordinate system. For example, the data cell 214 has comers at (1, 1), (1, 2), (2, 
2), and (2, 1). Also, the data cell 216 has comers at (5, 4), (5, 5), (6, 5), and (6, 4). 
Next, a st^ 316 determines whether or not a particular data cell includes any 
5 edges, either valid or invalid. Determiningfhe validity of an identified edge is 

described in detail below. The purpose of step 3 1 6 is to identify anything that might 
be an edge. Referring to Fig. 9, an exemplary data cell is identified by reference 
numeral 218. The data cell 218 has a center at (3.5, 5.5) and has adjacent data cells 
220, 222, 224, and 226 which have centers at (2.5, 5.5), (3.5, 6.5), (4.5, 5.5), and 

10 (3.5, 4.5) respectively. In a preferred aspect of the step 3 16, the point between the 
center of a data cell of interest and the center of an adjacent data cell is evaluated to 
' determine whether or not an edge is present. For example, the edges of the data cell 
218 can be determined by looking at the points (3, 5.5), (3.5, 6), (4, 5.5), and (3.5, 
5). Accordingly, the edges 228, 230, 232, and 234 of the data cell 218 can be an 

1 5 identified. Preferably, this is repeated for each data cell of the edge image 200 such 
that all potential edges of all of the data cells of the edge image are identified. Such 
an evaluation may be accomplished visually or graphically and is preferably 
accomplished by utilizing well-known image analysis software. In other words, the 
edge image 200 is preferably in a digital format, which may be analyzed as such 

20 with appropriate computerized image analysis techniques, which are themselves 
well known in the art. 

Next, a step 318 assigns numerical values to each of the comers of the data 
cells of the edge .image, which numerical values may be used to eliminate invaUd 
edges. Preferably, numerical values are assigned to each of the comers of each of 

25 the data cells based on the number of edges fliat radiate from a particular comer. In 
accordance with the present invention a set of numerical values may be detomined 
that can identify a particular comer as having an invalid edge radiating therefrom. It 
is noted that a comer of a cell that does not have any edges radiating therefrom may 
be assigned a value of zero or maybe ignored altogether for the purposes of this 

30 analysis. For example, an edge that leaves a comer in a first direction can be 
assigned a value of 1 . An edge that leaves a comer in a second direction can be 
assigned a value of 2. An edge that leaves a comer in a third direction can be 
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assigaed a value of 4. And, an edge that leaves a comer in a fourth direction can be 
assigned a value of 8. A particular comer can then be assigned a value that is the 
sum of the values if the edges leaving that particular comer. For the purpose; of this 
application and for illiistration, the above-described directions will be referred to as 
5 up, left, down, and right respectively with respect to tiiie Figures of the present 
application. 

Accordingly, referring to Fig. 10, each of the comers of the cells having 
edges radiating there£ix>m are labeled with the values assigned fiom the above 
technique. As an example, the data cell 218 has comers at (3, 5), (3, 6), (4, 6), and 

10 (4, 5). The comer at (3, 5) includes an edge leaving in the up direction (assign a 
value of 1) and an edge leaving in the rigjht direction (assign a value of 8) and 
therefore the comer is assigned a value of 9. The comer at (3, 6) includes an edge 
leaving in the down direction (assign a value of 4) and an edge leaving in the right 
direction (assign a value of 8) and therefore the comer is assigned a value of 12. 

15 The comer at (4, 6) includes an edge leaving in the down direction (assign a value of 
4) and an edge leaving in the left direction (assign a value of 2) and therefore the 
com^ is assigned a value of 6. Finally, the comer at (4, 5) includes an edge leaving 
in the down direction (assign a value of 4), an edge leaving in the left direction ' 
(assign a value of 2), an edge leaving in the up direction (assign a value of 1), and an 

20 edge leaving in the right direction (assign a value of 8) and therefore flie comer is 
assigned a value of 15. Because, as illustrated, llie edge image 200 contains edges 
■ which are all valid, each of the numerical values assigned to the comers of the cells 
of the edge image 200 may be utilized to indicate a valid comer having valid edges 
leaving therefiwm. That is, in an aspect of the presCT.t invention, numerical values 

25 for comers having valid edges leaving thereftom include at least 3, 5, 6, 9, 10, 12 
and 15. 

In Fig. 1 1, an edge image 400 is illustrated which contains several invalid 
edges and which will be used in order to explain how step 3 1 8 of the process 300 
may be utilized to eliminate such invalid edges. A first invalid edge 402 can be seen 
30 which leaves a cell comer located at (5, 7) and which also leaves a cell comer 

located at (6, 7). The edge 402 is determined to be invalid because such an edge is 
not physically possible in a relief or topographical pattern. Additionally, the edge 
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402 may be designated as invalid because such an edge is not allowed in accordance 
with an aspect of a particular code. Accordingly, the cell comers may be assigned 
numerical values of 8 and 2 respectively. As such, the numerical values of 8 and 2 
identify comers that may have an invalid edge leaving therefrom. In order to 
5 determine if a particular edge is invalid, adjacent comers are considered together and 
where both comers have been assigned invalid numerical designations, the edge that 
is common to both comers may be identified as an invalid edge. 

Another exemplary invalid edge 404 is illustrated in Fig. 1 1. As discussed 
above with respect to the edge 402, the edge 404 would not be a physically possible 

1 0 edge in a relief pattern. The edge 404 is common to the comer at (5, 5) and the 

comer at (5, 4). Accordingly, the comer at (5, 5) may be assigned a numerical value 
of 14 and the comer at (5, 4) may be assigned a numerical value of 11 . Further, 
edges 406, 408, and 410, which also each invalid edges, are illustrated. The edges 
406, 408, and 410 identify additional numerical values of 1, 4, 7, and 13 that may 

1 5 also be utilized in identifying invalid edges. Tharefore, in an aspect of the present 
invention, numerical values for comers that may have invalid edges leaving 
therefirom include at least 1, 2, 4, 7, 8, 1 1, 13, and 14. 

Another test may be used instead of or in addition to that described above in 
order to eliminate invalid edges within step 320 by identifying comers fliat have an 

20 odd numb©: of edges leaving ttierefinm. That is, in accordance with the present 
invention, a comer having an odd number of edges leaving therefiom indicates an 
error. Referring to Fig. 11, the comers at (2, 4), (3, 4), (5, 4), (5, 5), (5, 7), (6, 7), (7, 
6), and (7, 7) each have an odd number of edges leaving therefirom. Specifically, for 
example, the comers at (5, 4), (5, 5), and (2, 4) each have three edges leaving 

25 therefrom while the remaining comers of the other invalid edges have one edge 
leaving therefrom. Thus, an edge may be identified as invahd where the edge is 
common to comers that have an odd number of edges leaving therefiom. For 
example, the comers at (5, 4) and (5, 5) each have three edges leaving therefrom and 
have connmon edge 404. Thus, edge 404 can be identified as invalid. Also, by the 

30 same analysis, edges 402, 406, and 408 may be identified as invalid edges. 

Before the message contained in a symbol or edge image (such as the edge 
image 400) can be decoded, logical values or codes are assigned to each of the data 
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cells. Preferably, binary values that indicate on or off, black or white, etc., such as 
the numerical values of 0 and 1 , are used. As such, a further step 322 can be 
conducted that scans a row to assign binary values to each of flie data cells followed 
by a step 324 that scans a column to assign binary values to each of the data cells. 
5 Referring to Fig. 1 3 the steps 322 and 324 may comprise scans in opposing 

directions for providing further error checking capability as described below. It is 
noted that the rows and columns may be scaimed in any ord«- including 
simultaneously. It is noted that a decode step 326 may be performed at any time 
after binary values are assigned to the cells. For example, after one or both of a row 

1 0 or column scan is performed the decode step 326 may be perfonned (see Une 323 in 
Fig. 7). Moreover, at any point in the process where a binary value can be assigned 
to one or more data cells a decode step can be performed. 

A scan in the rows of step 322 may first be performed in the direction of left 
to right of each of the rows of the edge image 400. Preferably, a binary value, such 

15 as 0 or 1 , is assigned to each of the data cells for creating a symbol image 400 with 
properly identified data cells that may subsequently be decoded. Values are 
assigned by first assigning an initial value such as 1 to the first data cell of a row 
(the left most data cell). Next, a value is assigned to an adjacent data cell depending 
upon whether there is an edge between the adjacent data cells or not. If an edge is 

20 presrait, the adjac^t cell is assigned the value opposite fit)m the value of the 

previous data cell. If no edge is present, the adjacent data cell is assigned the same 
value as the previous cell. For example, Fig. 12 illustrates binary values that could 
be assigned by such as scan. To conduct a left to right scan of step 322, the binary 
values can be positioned in the lower right quadrant of the cross that marks the 

25 center of each of the data cells. A scan can also be performed in the opposite or 
right to left direction of the rows and values can be positioned in the upper right 
quadrant of the crosses that mark the center of each of tiie data cells. As will be 
described below, the values obtained by a scan in the columns by step 324 can be 
positioned in the upper left quadrant for a top to bottom scan and in the lower left 
. 30 quadrant for a bottom to top scan. 

As an example, the row of the edge symbol 400, shoAvn in Fig. 12, which 
contains the data cells that have their centers at (5.5, 1 .5), (5.5, 2.5), (5.5, 3.5), (5.5, 
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4.5), (5.5, 5.5), (5.5, 6^5), (5.5, 7.5), and (5.5, 8.5), will be described. Each of the 
data cells has been labeled as A, B, C, D, E, F, G, and H respectively for reference. 
Firstly, the initial data cell, specifically, the data cell labeled by A is assigned the 
value of 1. Next, because there is an edge between the data cells A and B, the data 
5 cell B is assigned the binary value opposite that of the previous data cell or 0. 
Again, because there is an edge between the data cells B and C, the data cell C is 
assigned the binary value of 1 . And, for the same reason, the data cell D is assigned 
the binary value of 0. Because there are no edges present between fbe data cells D 
and E, E and F, and F and G, the data cells E, F, and G are assigned to the binary 
1 0 value of 0. Finally, because there is an edge between the data cells G and H, the 
data cell H is assigned the binary value of 1 . 

Preferably, binary values are assigned to all of flie cells by scanning the rows 
in both directions and in the manner described above. Thus, the resulting binary 
values are positioned in the upper and lower right quadrants of the crosses that mark 
15 the centers of each of the data cells for a right to left and left to right scan 

respectively and are shown in Fig. 12 for the edge image 400. Also, each of the 
columns of the edge image are preferably scanned and assigned binary values in the 
same manner as was performed above with respect to the scan of the rows of the 
edge image 400. Accordingly, the resulting binary values for the columns are 
20 positioned in the i^er and lower left quadrants of the crosses that mark the centers 
of each of the data cells for a top to bottom and a bottom to top scan respectively. 

Next, a step 336 determines the binary values for each of the data cells by 
analyzing the binary value assigned by the four scans of steps 322 and 324. This 
analysis may include considering the net value of the four scans. For example, 
25 referring to data cell A of Fig. 1 2, the net value of the binary values assigned to cell 
A is 4 (1+1+1+1). Each of the scans has assigned a value of 1 to the cell. In other 
words, the binary value of cell A is unanimously equal to 1 as all of the scans are in 
agreement. Accordingly, a net value of the four scans of steps 322 and 324 equal to 
four may be used to indicate that the data cell can be assigned a binary value of 1 . 
30 Similarly, the data cell B has been assigned the binary value of zero for each of the 
four scans. Thus, for the same reason, a net value of zero for the four scans may be 
used to indicate fliat the data ceU can be assigned the binary value of zero. Once the 
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binary values for all the data cells have been determined by step 336 a step 326 may 
be performed, which step 326 attempts to decode the edge image based on the binary 
values assigned in 336. If the edge image is successfiilly decoded, a decision may 
be made at a step 328 to save the message and proceed to a step 330, which step 330 

5 considers wheflier or not more objects have been identified in step 304. If there are 
more objects to consider then the process 300 proceeds to a step 332, which begins 
the analysis of a next object in accordance with the present invention. If there are no 
other objects to be analyzed then the process ends at a step 334. It is noted that if 
the edge image caimot be decoded then the process may continue to step 330 to 

1 0 consider any other objects or the decode may be re-tried. For example, the decode 
may be re-tried with different thresholds defined in order to decode the message. 

"With respect to the binary values assigned to the cells of the edge image 400 
shown in Fig. 12 for the four scans discussed above, it is noted that the edge image 
400 of Fig. 12 does not include any invalid edges. As such, the edge image 400 of 

15 Fig. 12 is shown in Fig. 14 widi several invalid edges illustrated (edges 402, 404, 
406, 408, and 410) in order to explain how the scans of steps 322 and 324 can be 
used to assign binary values to the cells of the edge image that can be used to decode 
the edge image. Several data cells are labeled as 1, J, K, L, and M for reference. 
Also, Fig. 14 shows the binary values that can be assigned by the four scans of steps 

20 322 and 324. Firstly, the binary value of 1 may be assigned to the data cells that 
have a net value of four for the binary values assigned by the four scans of stq>s 322 
and 324 (see cell I). Also, for tiiose cells that have a net value of zero the binary 
value of zero may be assigned (see cell L). A net value of either 1 or 3 for a cell 
indicates that the correct binary value for the cell was known in 3 out of 4 of the 

25 scans. In other words, the correct binary value was known in both of the scans 
(forward and backward) for either a row or column but not both. For example, 
referring to the cell labeled M in Fig. 14, a net value of 1 for the cell M may be 
assigned. In the column scan fi-om top to bottom a binary value of zero has been 
assigned while the scan fiom bottom to top disagrees and assigns a binary value of 

30 1 . However, both the right to left and left to rigiht scans agree and assign a binary 
value of zero. Therefore, because the binary value of zero has been assigned by 3 of 
the 4 scans, the cell may be assigned the binary value of zero to be used to decode 
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the edge image 400. The same analysis may be used for a cell having a net value of 
3. For example, the cell labeled J has a net value of 3 and may be assigned the 
binary value of 1 because the binary value of 1 was assigned for 3 out of the 4 scans. 
Finally, a net value of 2 for a cell indicates that scans in opposite directions of a row 

S and column are in disagreement. Thus, such a cell cannot be assigned a binary value 
and may be labeled as unknovm. For example, the cell labeled K has a net vj^ue of 
2 and may be labeled as unknovm. 

It is noted that if only a top to bottom colunm scan and a left to right row 
scan were performed, for example, a binary value of zero might have been assigned 

10 to cell K in error (cell K should be assigned the binary value of 1 ). Because it is 
generally preferred lhat a cell be identified as unknown ratha: than incorrect, 
performing four scans provides sufScient information to assign correct binary values 
to certain cells and to identify certain other cells as unknovm particularly where 
invalid edges are present Accordingly, assignment of incorrect binary values to 

1 5 cells can be minimized or eliminated. 

Nimieroiis diaracteristics and advantages of the invention m^nt to be 
described by this document have been set forth in the foregoing description. It is to 
be undo^tood, however, that while particular ferms or embodiments of the invention 
have been illustrated, various modifications, including modifications to shape, and 

20 arrangement of parts, and the like, can be made without departing from the spirit and 
scope of the invention. 
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What is claimed is: 

1 . A method of determining features of a symbol based on a relief pattern 
having a data cell with at least one discernible edge and representing 
encoded information, the method comprising tiie steps of: 

determining the presence of discernible edges of the relief pattern and 

compiling information representative of an edge image 

including tiie discernible edges; 
validating the edge image by performing an edge analysis of at least 

one of the discemable edges; and 
determining a data cell of the symbol from the edge image so that the 

symbol can be decoded to provide the information encoded 

within the relief pattern of the symbol. 

2. The method of claim 1 , wherein the step of determining the presence of 
discernible edges of the relief pattern comprises imaging the relief pattern of 
the symbol with an imaging device. 

3 . The method of claim 2, wherein the imaging of the relief pattern comprises 
obliquely directing light onto the relief pattern. 

4. The method of claim 3, wherein the imaging of the relief pattern further 
comprises utilizing contrast in light reflectivity to determine the presence of 
discernible edges. 

5. The method of daim 1, wherein the validating step comprises assigning a 
symbolic value indicative of the validity of a discemable edge to an 
intersection of a plurality of discemable edges. 

6. The method of claim 5, wherein tiie symbolic value comprises a numerical 
value. 

7. The method of claim 6, wherein a numerical value indicative of the validity 
of a discemable edge assigned to tiie intersection of a plurality of discemable 
edges is based on the number of discemable edges that forin the intersection 
of a plurality of discemable edges. 
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8. The method of claim 6, wherein the validating step include validating the 
discemable edge based on a numerical value assigned to a first intersection 
of discemable edges, which first intersection includes the discemable edge to 
be validated. 

9. The method of claim 8, wherein the validating step further includes 
validating the discemable edge based on a numerical value assigned to a 
second intersection of discemable edges, which second intersection includes 
fhe disconable edge to be validated. 

10. The method of claim 1, wherein the validating step includes validating a 
discernible edge by determining the number of discernible edges that radiate 
fmm a first intersection of a plurality of discernible edges, which first 
intersection includes the discemable edge to be validated. 

1 1 . The method of claim 10, wherein the validatmg step fijrther includes 
validating a discernible edge by determining the number of discernible edges 
that radiate firom a second intersection of a plurality of discernible edges, 
which second intersection includes the discemable edge to be validated and 
which is adjacent to the first intersection of discemable edges. 

12. The method of claim 1, wherein the determining a data cell step comprises 
assigning a binary value to at least one data cell so that the symbol can be 
decoded. 

13. The method ofclaim 12, wherein the assigned binary value comprises zero 
or one. 

14. The method of claim 12, wherein the assigned binary value comprises black 
or white. 

15. The method of claim 12, wherem &e assigned binary value comprises on or 
off. 

16. The method of claim 12, wherein the determining a data cell step comprises 
scanning the edge image in a first direction to assign a binary value to at least 
one data cell. 

1 7. The method of claun 1 6, wherein the first direction comprises a row of die 
edge image. 

1 8. The method of claim 1 7, wherein the row is scanned in a left to right 
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direction to assign a binary value to the at least one data cell and the row is 
also scanned in a right direction to left direction to assign a binary value to 
the at least one data cell. 

1 9. The method of claim 1 8, wherein the determining a data cell step further 
comprises scanning tiie edge image in a second direction to assign a binaiy 
value to at least one data cell by the scan in the &st direction. 

20. The method of claim 19, wherein the second direction comprises a column of 
the edge image. 

21 . The method of claim 20, wherein the column is scanned in a top to bottom 
direction to assign a binary value to the at least one data cell and the column 
is also scanned in a bottom to top direction to assign a binary value to the at 
least one data cell. 

22. The method of claim 21 , wherein plural binary values assigned to the at least 
one data cell are analyzed to determine a single binary value for the at least 
one data cell. 

23. The method of claim 12, further comprising the step of decoding the edge 
image based on the assigned binary value to provide the information encoded 
within the symbol. 

24. An apparatus for reading features of a symbol based upon a relief pattern 
having at least one discemable edge and representing encoded information, 
the apparatus comprising: 

means for sensing a reflected light pattern and creating an edge image 
based upon the reflected Ught fix>m the relief pattern; and 

means for verifying the validity of a discemable edge of the edge 
image and for determining a data cell of a symbol based on 
the relief pattern so that the symbol can be decoded to provide 
the information encoded within the relief pattern. 

25. The apparatus of claim 24, as part of a system including a Ught source 
capable of at least partially illuminating the relief pattern so that the at least 
one discemable edge can be read. 

26. The apparatus of claim 24, wherein the means for sensing a reflected light 
pattem and creating an edge image comprises a reader. 
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27. The apparatus of claim 26, whaein the reader comprises at least one sensor 
capable of sensmg at least a portion of the reflected light fiom the relief 
pattern. 

28. The apparatus of claim 27, wherein the reader further comprises memory for 
storing instruction sets and for storing an image to be decod'ed. 

29. The apparatus of claim 27, wherein the reader further comprises a central 
processing unit for controlling a decoding algorithm for analyzing the edge 
image. 

30. The apparatus of claim 27, wherein the reader further comprises an imaging 
device for converting the sensed reflected Ught pattan into a plurality of 
electrical signals. 

3 1 . The apparatus of claim 28, wherein the imaging device comprises a charge- 
coiq)led device. 

3 2. The apparatus of claim 28, wherein the imaging device comprises a CMOS 
imaging device. 
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